Using Music to Interact with a Virtual Character
نویسندگان
چکیده
We present a real-time system which allows musicians to interact with synthetic virtual characters as they perform. Using Max/MSP to parameterize keyboard and vocal input, meaningful features (pitch, amplitude, chord information, and vocal timbre) are extracted from live performance in real-time. These extracted musical features are then mapped to character behaviour in such a way that the musician’s performance elicits a response from the virtual character. The system uses the ANIMUS framework to generate believable character expressions. Experimental results are presented for simple characters.
منابع مشابه
The relation of improvisation in music & Social character of improviser
This research investigates the relation of social practices and behavior of the musician or singer with the quality of his improvisation in the field of music. Using analytic method and field study, it explores the views of two groups of interviewees in the form of two separate statistical communities. The first sample consists of outstanding teachers of music in sixties and nineties which deal...
متن کاملInvestigating the Effect of Music on Spatial Learning in a Virtual Reality Task
Background: Spatial learning and navigation is a fundamental cognitive ability consisting of multiple cognitive components. Despite intensive efforts conducted with the assistance of virtual reality technology and functional Magnetic Resonance Imaging (fMRI) modality, the music effect on this cognition and the involved neuronal mechanisms remain elusive. Objectives: We aimed to investigate the...
متن کاملVisualizing Emotion in Musical Performance Using a Virtual Character
We describe an immersive music visualization application which enables interaction between a live musician and a responsive virtual character. The character reacts to live performance in such a way that it appears to be experiencing an emotional response to the music it ‘hears.’ We modify an existing tonal music encoding strategy in order to define how the character perceives and organizes musi...
متن کاملThe Third Room: A 3D Virtual Music Framework
This paper describes a new paradigm for music creation using 3D audio and visual techniques. It describes the Third Room, which uses a Kinect to place users in a virtual environment to interact with new instruments for musical expression. Users can also interact with smart objects, including the Ember (modified mbira digital interface) and the Fluid (a wireless six degrees of freedom and touch ...
متن کاملReal-time Music Visualization Using Responsive Imagery
We present a music visualization system that allows musical feature data to be extracted in real-time from live performance and mapped to responsive imagery. We have created three example mappings between music and imagery, illustrating how music can be visualized through responsive video, virtual character behaviour, and interactive features inside an immersive virtual space. The system is imp...
متن کامل